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SUMMARY 


This  report  shows  that  when  the  extended  Yule-Walker  equations  are  used 
to  estimate  the  autoregressive  parameters  of  an  autoregressive  moving- average 
time  series,  the  parameter  estimates  are  asymptotically  unbiased  and  normal. 
The  covariance  matrix  is  evaluated  for  the  general  autoregressive  moving- 
average  case  and  for  the  special  case  of  autoregressive  plus  noise  series. 

The  evaluation  of  the  asymptotic  statistics  of  the  corresponding  spectral 
estimate  remains  to  be  completed. 


1 


I .  INTRODUCTION 


In  memy  applications,  such  as  those  found  in  radar,  sonar,  speech  anal¬ 
ysis  ,  and  econometrics ,  one  may  assume  that  the  (^served  time  series  is  gener¬ 
ated  (or  adequately  modeled)  by  an  autoregressive  moving-average  (ARMA)  model. 
In  these  cases  the  first  estimation  problem  is  that  of  estimating  the  model 
parameters  from  the  observed  time  series,  in  some  applications,  only  the 
autoregressive  (AR)  parameters  will  be  of  interest.  The  problem  considered  in 
this  report  is  the  evaluation  of  asymptotic  statistical  properties  for  esti¬ 
mates  of  the  AR  parameters  of  an  ARMA  series  from  a  finite  set  of  observa¬ 
tions.  We  also  consider  the  related  special  case  of  estimating  the  AR  param¬ 
eters  of  an  AR  series  corrupted  by  additive  noise.  In  both  cases  the  extended 
Yule-Walker  (Y-W)  equations  (see  Gersch^ )  are  used  for  parameter  estimation. 

12  3 

Similar  problems  have  been  considered  by  Gersch  ,  Walker  ,  and  Pagano  . 
Gersch  uses  the  extended  Y-W  equations  to  form  asymptotically  unbiased  esti¬ 
mates  of  the  AR  parameters  of  an  ARMA  series.  He  indicates  (but  does  not 
prove)  that  the  limit  distribution  of  the  estimates  is  normal  and  evaluates 
the  asymptotic  covariance  matrix.  Walker  was  the  first  to  consider  the  prob¬ 
lem  of  estimating  the  AR  parameters  of  an  AR  series  corrupted  by  additive 
noise.  He  evaluated  the  asymptotic  efficiency  and  variance  of  the  parameter 
estimates  for  a  first  order  AR  series.  Pagano  proves  that  the  correct  model 
for  an  AR  series  plus  noise  is  an  ARMA  model  and  through  the  use  of  nonlinear 
regression  methods  develops  strongly  consistent  efficient  parameter  estimates. 
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In  this  report,  under  the  assumption  that  the  AR  or  ARMA  series  is  Gauss- 
iem  distributed,  we  derive  the  asymptotic  statistical  properties  for  the  AR 
parameter  estimates  based  on  well  known  asymptotic  statistical  properties  of 
standard  covariance  estimates  (Parzen^).  For  the  estimation  of  the  AR  param¬ 
eters  of  an  AR  plus  noise  series.  Walker's  results  are  extended  proving  asymp¬ 
totic  normality  and  obtaining  the  asymptotic  covariance  for  arbitrary  model 
order.  For  the  estimation  of  the  AR  parameters  of  an  ARMA  series,  Gersch's 
results  are  extended  by  providing  a  more  precise  derivation  of  the  asymptotic 
covariance  matrix  and  by  proving  that  the  limit  distribution  is  normal. 

The  organization  of  the  report  is  as  follows:  In  Section  II  we  define 
the  extended  Y-W  eguation  estimates  and  establish  certain  definitions  required 
in  Section  III.  In  Section  III  we  prove  that  the  limit  distribution  is  normal 
and  evaluate  the  asymptotic  covariance  matrix  for  the  extended  Y-W  equation 
estimates.  A  separate  covariance  matrix  is  derived  for  the  AR  series  plus 
noise  case. 


II.  PRELIMINARIES 


Let  _  a,  3  discrete  parameter  time  series  generated  (or  modeled) 

by  a  zero-mean  autoregressive  moving  average  process  of  known  order, 

ARMA(p,g).  We  write 


Y 

n 


1  n-1 


%  -  “"l 


'n-1 


b 

q 


n 


n-q 


(1  ) 


a  Y 
P  n-p 


•  •  • 


where  the  sequence  is  assumed  to  be  stationary,  independent,  identically 

distributed  (i.i.d.)  with  zero  me£m  and  variance  a  The  set  {a.}?  .  is 

n  1  1=1 

referred  to  as  the  autoregressive  (AR)  parameters  and  the  set  is 

referred  to  as  the  moving  average  (MA)  parameters. 

Define  the  polynomials  in  z,  z  complex,  by 


A^(z)  F  1 


a .  z 
1 


j 


(2a 


B^{z) 


(2b: 


p  q 

We  assume  that  all  zeroes  of  A  (z)  and  B  (z)  lie  outside  the  unit  circle  on 
the  complex  z-plane  and  that  the  polynomials  have  no  common  zeroes.  The  pro¬ 
cess  Y  is  guaranteed  to  be  stationary  by  this  assumption.  For  the  stationary 
process  the  spectral  density  is  given  by; 


<ti(X) 


|B^(e^Sr 

|AP(e^^r 


(31 


We  evaluate  the  autocovariance  sequence  for  the  Y  process  by  multiplying 


Equation  1  through  by  Y  ,  and  taking  expectations  term  by  term,  we  obtain 


n-k 


n-k  n-1 


n-k  n-p 


=  E  [Y 


n-k 


n_l  -  b  E  [Y 


n-k  n-1 
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E  (Y 


n-k 
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n-q 
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(4) 


Define  the  covariance  sequence  for  the  Y  process  to  be  where 

r,  =  E  [Y  Y  ,1,  since  Y  ,  does  not  depend  on  inputs  n  .  for  n-j>n-k,  i 
k  n  n-k  n-k  ^  n-j 

follows  that  E  [Y  .  n  .1=0  for  k>j,  thus  we  can  rewrite  Equation  4  as 
n— K  n— ] 


r^  -  a^  rj^_.  -  ...  -  a^  rj^_p  =  0  k  =  q+1  ,  q+2,  ...,  q+p 


This  set  of  equations  is  referred  to  as  the  extended  Yule-Walker  equations 

Let  r  be  a  (pxp)  covariance  matrix  with  elements  F,  .  =  r  ,,  ... 

-q  k:  q+(k-3 ) 

’^q  ’^q-l  •••  ’^q-pfl 
’^q+l  ^q  ***  *^q-FH-2 

’^q+p-l  ’^q+p-2  *•*  "^q 
and  define  the  (pxl )  vectors  by 

^  =  [a^,  a^,  ...  a^] 

T 

R  “[r  .r  ,,...r  ] 

—  q  q+1  q+2  q+p 


then  Equation  5  can  be  written  in  matrix  form  as 


Gersch  proved  that  the  non-sytninetric  Toeplitz  matrix  q  finite,  is  nonsin¬ 
gular;  thus  a  solution  for  Equation  7  always  exists. 


Given  a  finite  set  of  observations  {Y  N  >  p+q,  we  estimate  the 

n  n=i  —  tr 

covariance  sequence  by 


|k|  <  N-1 


|k|  >  N-1 . 


When  the  covariances  rj^  in  the  matrix  and  vector  are  replaced  by  their 
corresponding  estimates  using  Equation  8,  the  resulting  matrix  and  vector  are 
denoted  by  and  R^.  The  extended  Y-W  equations.  Equation  7,  can  be  written 
in  terms  of  the  estimated  quantities  as 


r  a  =  R  . 
-q  —  -q 


These  equations  are  used  for  estimating  the  AR  parameters  of  an  ARMA  series. 


In  subsequent  developments  of  the  asymptotic  statistical  properties  of 
the  estimates  £  formed  using  Equations  9  and  8,  we  use  the  following  vectors 
and  matrices 


i  ■  "o’  . Vq' 


u  S  (.Kk+J)*  *  .ilk-j)*,  k.o,  , . .  J.0,  , . 
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A.  FUNDAMENTAL  PROPERTIES  AND  ASSUMPTIONS 


Let  Y  =  {y  }  be  a  discrete  time  stochastic  process  defined  on 

n  n  =  -“ 


satisfying; 


ASSUMPTION  1:  Y  =  {Y  }  is  a  real-valued  stationary  Gaussian 

“ "  '  '  ■  -  -  ■  n  n  “ 


process  with  zero  mean  and  cibsolutely  continuous  spectral  distribution 
function  with  spectral  density  ♦(X)  which  is  strictly  positive  and  bounded. 


Under  Assumption  1,  it  follows  by  Kromer  ,  Theorem  2.1,  that  there  is  a 


real  sequence  =  i  ®  positive  real  number  a  such  that  the  process  Y 


admits  an  infinite  MA  representation  with  spectral  density 


♦<»)  n  ♦  i: 


D  =  1 


i  jX  , 

c .  e 
J  ' 


(T 


ASSUMPTION  2:  The  infinite  sequence  {c.}  satisfies 


We  proceed  to  establish  the  asymptotic  distribution  of  the  covariance 


estimates  (Equation  8) 

THEOREM  1 ;  Under  Assumptions  1  and  2,  the  elements  of  the  covariance 
error  vector 


N 


1/2 


(R  -  R) 


are  asymptotically  jointly  multivariate  normal  with  mean  zero  and  covaria 
structure  given  by 


lim  cov  {n’^^(R  -  R)  ,n’^^(R  -  R)*^}  =  2n  /  dX.  (11) 

N*«  -n 

This  result  was  proven  by  Kromer  in  Theorem  3.2.  Define  for  later  use  the 
p+q+1  X  p+q+1  covariance  matrix  ^  by 

.ir_ 

T_  =  2iry^  U  ♦  (X)  dX  .  (12) 

-IT 

The  following  lemma  establishes  a  convergence  in  probability  result  that 
is  fundamental  to  the  proof  of  the  main  asymptotic  results. 


LEMMA  1 ;  Under  Assumptions  1  and  2 


as  N  — ►  « 


for  all  finite  q 


4 

PROOF;  Parzen  states,  under  assumptions  satisfied  by  our  Assumptions  1 

and  2,  that  the  estimate  r  of  Equation  8  converges  almost  surely  to  r  as 

K  K 

N— It  follows  directly  that 


r 

-q 


r  as  N— ►<«• 

-q 


for  all  finite  q.  Gersch  proves  that  the  matrix  is  ncnsingular  and  thus 


guarantees  the  existence  of  T  .  Since  the  matrix  inverse  is  a  continuous 

-q 

function,  then  on  a  neighborhood  containing  it  follows  (Rao^)  that 


"-1  P  -1 
r  r  as  N^«. 

-q  -q 

The  next  lemma  establishes  a  relationship  between  a  vector  of  covariance 

A 

estimates,  a  matrix  of  the  AR  parameters  £,  and  the  extended  y-w  equations. 
It  is  through  this  relationship,  in  conjunction  with  Theorem  1 ,  that  we  will 
establish  the  asymptotic  distributional  properties  of  the  AR  parameter 
estimates  of  Equation  9. 


LEMMA  2:  For  any  ARMA(p,q)  process  there  is  a  pxp+q+1  matrix  D  such  that 


D(R  -  R) 


r  a 

-q- 


where  the  matrix  ^  is  comprised  of  the  AR  parameters  {a^ ,  ones  and  zeroes, 


This  result  follows  directly  from  the  definition  of  the  matrix  and  the 
extended  Y-w  equations,  see  Equations  7  and  9,  The  matrix  D  is  defined  in  the 


appendix 


LEMMA  3;  For  an  ARMA(p,q)  process  satisfying  Assumptions  1  and  2,  the 
elements  of  the  vector 

-  r  a) 

-q  -q- 

are  asymptotically  jointly  multivariate  normal  with  mean  zero  and  covariance 
matrix  structure  given  by 

lim  cov  {N  '  (R  -  r  a),N  '  (R  -Fa)  }  =  D  t  D  .  (13) 

— q  -q-  — q  -q-  - 

N-ooo 

This  result  follows  directly  from  Lemma  2  and  Theorem  1  with  the  matrix 
defined  by  Equation  12. 


B.  ASYMPTOTIC  PROPERTIES  OF  THE  AR  PARAMETER  ESTIMATES 


We  now  establish  the  asymptotic  distributional  properties  for  the  vector 
of  AR  parameter  estimate  errors  (^  -  a^) .  In  Lemma  3  we  established  asymptotic 
normality  and  evaluated  the  asymptotic  covariance  matrix  for  the  vector 


1  /2  "  " 

N  (R  -  r  a);  in  Lemma  1  we  proved  that  the  inverse  estimated  covariance 

-q  -q- 

''-l  —1 

matrix  converges  in  probability  to  as  N — Using  these  two  results, 
we  prove  the  following  asymptotic  distribution  result. 


THEOREM  2:  For  AR  parameter  estimates  of  Equation  9,  under  Assumptions  1 

1  /2  /V 

and  2,  the  elements  of  the  error  vector  N  (J.  ~  asymptotically  jointly 


normal  with  mean  zero  and  covariance  matrix  structure  given  by 


lim  cov  -  £)  -  a)"^}  =  r”’ D  d'^{  r~’ )^. 


PROOF;  By  Lenuna  3  it  suffices  to  show 


N^/^(a  -  a)  -  N’/^r~’{R  -  r  a)_^*  as  N- 

—  —  -q  -q  -q-  — 


Define  the  pxl  vector  Z  by 


k  f-'  (S 

-q  ~q 


1/2  -1 

N  r  (R  -  Fa), 

-q  -q  -q-' 


Leirana  3  implies  that 


1  /2 

lim  N  (R  -  r  a)  < 

N..  -q  -cr- 


and  by  Lemma  1  it  follows  that 


1  /2  ''-1  -1  z'  •  p 

^  =  N  (F  -F  )(r  -  Fa)_*.t  as  N— ►  ®. 

q  ~q  ~q  ~q—  — 


On  (n,(^P)  define  the  set  for  e>0  and  N>p  by 


=  {<*)£«:  <  E,  j  =  1,  2,  p}. 


By  Equation  15,  for  every  oiC[o,1]  there  exists  a  N*  ^  such  that 


P(A  )  >  1  -  a  for  N  >  N*  . 
E,N  —  —  e,a 


Since  |z.  I  <  e  for  j  =  1,  2,  ....  p  then  the  vector  T  (R 
'  3 ,n'  -q  — q 

all  tj>f  Jl  .  Hence,  by  Equation  9,  we  write 
e 


r  a)  exists  for 


r'(R  -ra)=a-a 
-q  -q  -q-  —  — 

for  all  mf  Jl  and  we  write  Z  as 
^  c  »N  — 

1  /2  /V  1  /2^  -1 

Z  =  N  '^(a  -  a)  -  N  r  (R  -  Fa) 

—  —  —  _q  _q  ~q- 

for  all  (i)£A^  Since  the  selection  of  c  and  a  is  arbitrary  we  conclude  that 

^  /7  ^  /2  ^  ^  P 

N  -  a)  -  N  '^V  (R„  -  T  a)_^*  as  N— ►». 

—  —  -q  -q  -q-  ^  — 

We  define  the  matrix  ^  to  be  the  asymptotic  covariance  matrix  established 
by  Theorem  2. 

-1  T  -1  T 

e  =  rDfD(r).  (i6) 

—  -q - -q 

We  now  examine  the  detailed  form  of  the  asymptotic  covariance  matrix  6  as  a 


function  of  the  assumed  form  for  (KX).  First,  we  use  the  ARMA(p,q)  form 
(Equation  3)  and,  secondly,  we  use  the  form  for  the  special  ARMA  case  of  AR(p) 


c 


GENERAL  ARMA(p,q)  CASE 


T 

We  first  examine  the  matrix  £  ^  which  by  Equation  12  can  be  written  as 


^  ^  =  In D  V  ^  dX.  (17) 

-ir 

T 

Let  C.  .  be  eui  element  of  D  U  D  ,  let  d,  .  be  an  element  of  D  and  let  u  .  be  an 

KD  —  )C7 

element  of  U.  We  can  write 


5 


)t,j 


p+q  pfq 

i?o  So 


h—  2f  » »  t  f  py  j  —  1^  2^  •  •  » r  p 


but  by  definition 


u^^  =  exp  [i(f-m)x]  +  exp  [i(A+m)x] 

thus 


P+q  pfq 

23  23  [i(*’-in)X]  +  exp  [i(a+m)X]} 

t=0  m=0  ^ 


P+q 

=  23 
1=0 


p+q  p+q 

23  d.  exp(-imX)  +  23  •  exp(imX) 

m=0  m=0  ■' 


(18) 


14 


Using  the  structure  of  the  matrix  ^  and  Equation  2a  we  write 


p+q 


t=0 


exp  (ilX)  =  exp  [i(q+k)X]  A^(e 


2i  ^  a  sin  {t-q-k)X 
t=q+k+ 1 


the  second  term  of  Equation  19  vanishes  for  k  ^  p-q.  We  also  write 


p+q  p+q 

Ed.  exp  (-imX)  +  Y'  d.  exp  (imX) 
im  jm 


m=0 


m=0 


=  exp  [-i(q+j)X]  A^(e^^)  +  exp  [ i (q+j ) X ]A^(e~^^) . 


By  Equations  18,  19  and  20,  after  further  manipulation,  we  detain 


(19 


(20 


C,  .  =  A^(e  )A^(e^^ )exp  [i(k-j)X]  +  A^(e  ^^)A^(e  ^^)exp  [i(k+j+2q)X] 


P  P 

-4i  V  ®+®<=  sin[  (t-k-q)X]  cost  (s-j-q)X] 

t=q+k+1  ^0 


(21 


the  third  term  of  Equation  21  vanishes  for  k  ^  p-q. 


Let  p  ,  be  cui  element  of  ^  »  then 


Pv  -i  =  2ir  /  C  (>^(X)  dx 


k  =  1,  2, 


P;  j 


1,  2, 


I 

Using  Equation  21  we  obtain 


! 

0,  .  -  2it  f  A^(e  ^^)A^(e^^)exp( i(k-j  ) X ]  ♦^(X)  dX 

“  n 

■  +  2k  f  A^(e'^^)A^(e'^^)exp[i(k+j+2q)X]  ^^(\)  dX  (221 


P  P 

-  Z  E  a 

t=q+k+1  s=0 

the  third  term  of  Equation  22  vanishes  for  k  2l  P-g«  To  simplify  further 
evaluation  of  ^  we  state  the  following  lemma  whose  proof  can  be  found  in  the 
appendix. 


LEMMA  4;  For  any  ARMA(p,q)  series  satisfying  Assumption  1  we  have 

2ir  A^(e  ^^)A^{e  exp(i{k+j+2q)X]  ♦^(X)  dX  =  0 

-IT 

for  k=1,  2,  ...  ,  p;  j  =1,  2,  ...  ,  p. 

By  Lemma  4  it  follows  that  the  contribution  of  the  second  term  of  Equa¬ 
tion  22  is  zero  over  the  range  of  k  and  jj  since  the  integrand  of  the  third 
term  is  an  odd  function  in  X,  its  contribution  is  also  zero  over  the  range  of 
k  euid  j,  therefore,  we  have 

P,  .  =  2ir  f  A^{e  ^^)A^(e^^)  exp(i(k-j)X]  t^CX)  dX. 


(23 


Using  the  ARMA  spectral  density  representation  for  ♦(X),  as  given  by  Equation 
3,  we  obtain 


0.  .  =  f  s'^Ce^^  )B‘^(e  exp[i(k-j)X]  ♦(X)  dx. 

k,3  n 


Let  ♦u-CX)  represent  the  spectral  density  for  a  moving-average  process,  that 
NA 

is  with  defined  by  Equation  2b,  we  write 


■S) 


and  p,  .  becomes 


TT 

^  =  2tr  exp[i(k-j)X)  dX. 


Let  tCj)  represent  the  covariance  sequence  of  the  moving-average  process,  then 
by  Box  and  Jenkins^  we  can  write 


q-Hl 


1^1  1  q 


|t|  >  q 


17 


where 


-1 ;  then  using  the  Fourier  transform  pairs 


c,  =xp(-m) 

1=-® 


rj^  =  y  ^(X)  exp(ikX)  dX 

-IT 


in  Equation  26  we  obtain 


T 

Since  p  .  is  an  element  of  D  f  D  ,  then  with  r  as  defined  by  Equation  6  with 
k,j  —  I 

q  =  t  we  have 


£1£"  -  ♦  £  c.  [£,  *  rjj. 

—  I 

Using  Equation  28  in  Equation  16  we  have  a  final  form  for  the  asymptotic 
covariance  matrix  0 


This  form  for  the  asymptotic  covariance  matrix  is  analogous  to 

g 

by  Gersch  and  Sakai  .  We  note  that  ^  contains  two  main  terms; 


that  obtained 
the  first  term 


is  similar  to  the  covariance  result  obtained  for  estimating  the  AR  parameters 


of  an  AR  process.  In  fact,  if  we  let  q=0,  this  term  reduces  to  the  classic 


9 

result  obtained  by  Mann  and  Wald  .  When  q  is  non-zero  the  second  term 
provides  the  contribution  to  the  covariance  due  to  the  presence  of  the 


movinq-average  process, 
symmetric  matrices. 


We  also  note  that  both  and 


q 


E 

1=1 


T 

are  real 


D.  SPECIAL  CASE:  AUTOREGRESSIVE  PROCESS  PLUS  NOISE 


In  the  previous  section  we  developed  the  asymptotic  distribution  and  form 

of  the  asymptotic  covariance  matrix  for  estimates  of  the  AR  parameters  from 

observations  of  an  ARMA  series.  We  now  consider  a  special  ARMA  series.  When 

2 

the  observed  series  consists  of  an  AR(p)  process  plus  i.i.d.  noise,  Walker 

3 

and  Pagano  showed  that  an  ARMA(p,p)  model  can  be  used  to  represent  the  ob¬ 
served  series.  Thus,  let  q=p  and  the  results  of  the  previous  section  cam  be 
applied  to  this  case. 

Let  {Z^}  be  a  discrete  parameter  tine  series  generated  by  the  sum  of  a 
zero  mean  autoregressive  process  of  known  order  and  an  i.i.d.  noise  sequence. 
We  write 


Z 

n 


Y  +  c 
n  n 


(30) 


where  {Y  }  is  an  AR(p)  process  generated  by  Equation  1  with  q=0  and  (c  }  is 
n  n 

2 

assumed  to  be  an  i.i.d.  noise  sequence  with  mean  zero  and  variance  o  . 


Given 


i.;. 

L'- 


a 


a  finite  set  of  observations  N>p,  we  estimate  the  AR  parameters  using 

the  extended  Y-W  equations,  since  the  process  Z  can  be  modeled  as  an 

ARMA(p,p)  series,  the  result  of  Theorem  2  applies  to  this  case  and  only  the 

detailed  form  of  the  asymptotic  covariance  matrix  9  as  given  by  Equation  16 

need  be  evaluated.  As  in  the  previous  case  we  first  examine  the  structure  of 
T 

the  matrix  »  whose  elements,  Pj^  j »  at®  given  by  Equation  23  and  which  is 

repeated  below 


.  =  2it  f  A^(e^^)A^(e  exp[i(k-j)Xl  dX. 

#  j  y 


(31  ) 


For  the  AR  plus  noise  process,  Z,  we  can  express  the  spectral  density  as 


♦  (X)  + 


2ir  A^Ce^^)  A^(e"^^) 


(32) 


Substituting  this  expression  into  Equation  31  we  obtain 


2 

P  If- 


^k,j  ~  2x  J 


expli(k-j)Xl  dX 


o  2  2 

2o  0  V 

c  n 


2ir 


y  exp(  i(k-j  )  XI  dX 


(33) 


4 

o  n 


+  y  A^(e^^)A^(e  ^^)  exp(i(k-j)X)  dX. 

-If 


20 


Performing  the  integrations  we  obtain 


2  2  2  4  I 

o  r(k-j)  +  o  a  «(k-j)  +  o  y 
n  r  n  C 


a  a  .  I 
m  m+ |k-3 | 


k—  1/  2f  •••  r  P;  j  —  If  2f 


Since  p,  .  is  an  element  of  D  f  D  we  can  write 

- 


T  2  2  2  4 

D  f  D  =  o  r.  +  0  0  I  +  o  Q 
—  r|— 0  c  n~ 


where  the  pxp  matrix  ^  is  defined  by 


P  -  P-1 

y'  a^  y'  a  a 

m  m  m+ 

m=0  m=0 


1  ‘  •  S 


^m^m+(p-1 ) 


*m®m+1 


a  a  / 

m  m+ ( p- 1 ) 


Using  Equation  34  in  Eouation  16  for  the  AR  plus  noise  process  we  obtain  a 
final  form  for  the  asymptotic  covariance  matrix  ^ 


2  -1  ,  -1,T  2  2  -1,  -1,T  4„-1  ,„-1.T 

0=or  r-(r  )  +oor  (r  )  +orQ(r  ). 

—  n-P  — 0  — p  €  n-p  — P  e-p  ^  -P 
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The  first  term  of  Equation  35  represents  the  contribution  to  the  covariance 


due  to  estimating  the  AR  parameters  of  a  non-noise  corrupted  process  using  the 
extended  Y-W  equations.  If  there  were  no  additive  noise  present,  this  would 
be  the  only  term  in  Equation  35.  The  second  and  third  terms  represent  the 
contributions  due  to  the  presence  of  the  additive  noise. 
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APPENDIX 


The  structure  of  the  (pxp+q+1)  matrix  £  is  most  easily  explained  by 
defining  two  submatrices  and  Define  ^  in  terms  of  D^  and  by: 


p+q+1 


The  structure  of  is  dependent  on  the  relation  between  p  and  q  and  must  be 
defined  separately  for  two  cases: 

For  q  [p/2]  the  j  row  of  is  given  by 


.+a  ..)f  — (a  .+a  )*••*, 

q+j  q+1-1  q+1+1  q+1-2  q+1+2 


(A 


(*) 


^^q+j-(p-q-j  )  ^q+j  +  (p-q-j  )^  '  ^®q-(p-q-2j  +  1  )  ^  '•••'  '^1'  ° 

'"p^ 


.  th 


For  q  <  Ip/ 2]  the  j  row  of  (j  =  1,  2,  ...  ,  [p/2]-q)  is  given  by 


M 


-a  .,-(a  .+a  ),-(a  +a  ), 

q+1  q+D-1  q+i+1  q+1-2  q+1+2 


^2q+2j-1^'  ~  *®2q+2j  ”  ~  ®2q+2j  +  r  "^p' 


the  remaining  rows  are  given  by  Equation  A1 . 


c 


I 


The  submatrix  is  defined  by. 


-a  -a 


P 

0 


p-A 

-a 


P-1 


proof  of  Lemma  4:  Define  6,.  by 

k » 3 


0 

1 


-a  -a 

P  P-1 


Using  (>  ( A ) ,  as  given  by  Equation  3,  in  Equation  A2  we  get 


k,  j  2t! 


exp  [ i ( k  +  j  +  2q) X ] dA , 


0 

0 


.  .  .  -a^  1 


6.  .  =  2ir  /"  A^(e^^)A^(e  exp  ti(k  +  j  +  2q)A]  (Ji^(A)dA.  (A2) 

K,3 


(A3) 


Since  the  zeroes  of  A  (z)  lie  outside  of  the  unit  circle  on  the  complex 
Z-plane ,  then  1/A^(Z)  is  analytic  inside  and  on  the  unit  circle,  thus  we  can 
write 


00  00 


1/[A^{e^^)]^  =  Y\  ^  c  c  exp  [i(m  +  m  )A] 

m .  m  _  I  z 


{A4) 


m^=0  m2=0  1  2 


26 


■■■  ■-  -■ 


^  ^  . 


. .  •  ~  ^  V  .J 


and  we  also  have 


[B^(e  )  B‘^(e  )]  -  ...  ^ 

t  =0  1=0  1234 

1  4 


E  ^  ». ».  '’i 


exp  {i(t^  -  -  1^)^) 


(A5) 


Using  Equations  A4  and  A5,  we  rewrite  Equation  A3 


a  ^TT  q 


Q  OD 


U  y%  n  -I  ^  _ 

B  =  —I  y  ’  •  y  y  y  ^ 


4  1  2 


b  b  b  c  c 

S  S  ‘4  ”2 


exp  [i(m^  +  +  d)xldx 


where 


d  =  k  +  j  +  2q  +  ~  Since  d  >  0,  it  follows  that 

B.  •  =  0  for  k  =  1,  2,  .  .  .  ,  p;  j  =  1,  2,  .  .  .  ,  p. 


